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(54) Process microscopy system 



(57) A confocal microscope system has a turntable 32 with object locations for mounting multiple samples 4 
to be examined in a ring. The turntable is rotated about an axis concentric with the ring. At least one confocal 
microscope optical system (30) is mounted with components movable axially and radially relative to the ring 
so that an object region may be scanned through samples mounted in the object locations, each microscope 
system including a point image detector (12) providing a signal output, and a demultiplexer 44 receiving the 
signal output and isolating signal segments associated with different sample locations. A multiple channel 
signal processor 46 process the signals associated with different locations, and a control unit 14 moves axially 
movable components of each optical system firstly to establish focus reference data for each object and then 
to control the focus of the microscope responsive to the focus reference data as it scans successive object 
locations. 




At least one drawing originally filed was informal and the print reproduced here is taken from a later filed formal copy. 
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PROCESS MICROSCOPY SYSTEM 
This system relates to process microscopy, and more 
specifically to a confocal microscope system suitable for 
5 the microscopic examination of large numbers of objects, for 
example microscope slides, in applications such as automated 
histological analysis, morphometry, inspections of semi- 
conductor wafers and micromachined components, and other 
applications involving the inspection or analysis of animate 
10 or inanimate objects of very small dimensions. 

scanning microscopes are well known in the 
microscopy art and confocal microscopes in particular are 
capable of providing enhanced resolution and the capability 
of three dimensional imaging of objects, utilizing the 
15 ability of such microscopes to reject image data other than 
that from the particular focal plane being scanned. 

A disadvantage of such microscopes is the 
considerable time generally needed to complete a scan of an 
object, which reduces the usefulness of the technology in 
20 process microscopy, where substantial numbers of objects 
require to be imaged. 

Attempts have been made to improve the speed of 
confocal microscopy by utilizing multiple aperture scanning 
disks, such as Nipkow disks, but such rotating scanning disks 
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increase the complication of the basically simple confocal 
microscope system, and are in general highly inefficient 
optically, which may again require a trade-off between 
resolution and speed. 

The principles of confocal microscopy were disclosed 
in U.S. Patent No. 3,013,467 (Minsky) , and are described in 
considerably more detail in the book "Confocal Microscopy- 
edited by T. Wilson, Academic Press, 1990. 

The present invention seeks to provide substantial 
improvements in the overall rate in which objects can be 
imaged or analyzed utilizing a scanning microscope, in 
process microscopy, without incurring penalties in the 
resolution and contrast ratio of the images obtained, and 
whilst providing efficient application of available 
computational power to the processing of data generated by 
the system. The system is applicable to the production of 
two and three dimensional images of objects in the form of 
slides as well as j n vitro and in vivo organisms. 

According to the invention, a microscope system 
comprises a turntable having multiple locations for mounting 
multiple objects to be examined in a ring, means for rotating 
the turntable about an axis concentric with the ring, and at 
least one scanning microscope mounted for radial movement 
relative to the turntable such that its focal point scans the 
25 object locations as the turntable rotates, and means for 
separately collecting data related to objects in each object 
location. Further features of the invention will be apparent 
from the following description and the appended claims. 
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Preferred embodiments of the invention are described 
with reference to the accompanying drawings, in which: 

Figures 1A and IB diagrammatically illustrate basic 
configurations of reflective and transmissive confocal 



microscope configurations; 

Figure 2 diagrammatically illustrates fundamentals 
of the system of the invention; 

Figure 3 illustrates diagrammatical ly a preferred 
5 optical configuration; 

Figure 4 is a diagrammatic plan view illustrating 
further features of the invention; 

Figure 5 diagrammatically illustrates further 
features of the control computer and electronics; and 
o Figure 6 is a diagrammatic isometric view of a small 

portion of a microscope slide r to which reference is made to 
illustrate certain aspects of the functioning of the 
invention* 



Figure 1A illustrates a known confocal microscope 
15 configuration. A light source 2, typically a laser providing 
a continuous high intensity light source of a visible or 
invisible (ultraviolet or infrared) radiation, appropriate to 
the type of imaging or examination being carried out r 
provides a point source of light which is focused upon a 
20 point on an object 4 by means of an objective lens 6. Light 
reflected from the object is collected by the lens 6 and 
intercepted by a half-silvered mirror 8 which diverts it so 
that it is focused on a detector comprising a mask 10 
defining a pin hole in front of a photodetector 12 ♦ The 
25 output from the photodetector 12 is passed to a computing and 
display device 14 , which also controls an X and Y scanning 
device 16 which moves the object 4 relative to in two 
dimensions relative to the focus of the lens 6. 



Figure IB illustrates how a basically similar 
30 arrangement may be utilized for the examination of an object 
4 by transmitted light. Here the half -silvered mirror 8 is 
omitted , and replaced by a further collector lens 18 between 
the object 4 and the photodetector 12. In this case, both 
the source 2 and the mask 10 are moved to provide scanning in 



two dimensions. 



Referring now to Figure 2, a light source 2A is 
shown to illustrate that the principles of the present 
invention may be employed in a system in which the microscope 
5 operates in transaissive mode, but all further description 
will assume that the microscope operates in reflective mode. 

The optical configuration utilized in a preferred 
embodiment is shown in Figure 3. The light source 2 is 
associated with a collimating lens 20 which projects a 

10 parallel beam through the half -silvered mirror 8 onto the 
lens 6, which in turn focuses the light at a point in or on 
the surface of a slide 4 forming the object. The focus of 
the lens 6 is controlled by a focusing device 22 f typically 
a piezoelectric crystal or voice coil 22 under open or closed 

15 loop control of a driver 24 which in turn receives 
instructions from a computer and control system 14. The 
collector lens 18 focuses light reflected from the object and 
intercepted by the mirror 8 onto the aperture of the pin hole 
mask 10, behind which the photodetector 12 (which may be a 

20 photomultiplier if required) generates an electrical signal 
proportional to the intensity of the incident light, which 
signal is passed to a preamplifier 26 and thence via an 
analog to digital converter (ADC) 28 to the computer 14. 
Conveniently , all of the optical components, including the 

25 light source, the focus coil and the photodetector, are 
mounted in a common housing 30 (see Figures 2 and 4). 

Referring to Figures 2 and 4, the slide 4 or other 
object is one of a substantial number, for example 72 
30 although it may be less or more, mounted in a ring on a 
turntable 32 rotatable by a motor 34 at a constant rate about 
an axis parallel to the optical axis 36 of the lens 6. The 
housing 30 is mounted on an arm 38, driven for radial 
movement relative to the turntable 32 by a stepping motor 40 



controlled by the computer 14. A scanning head 42, connected 
to the computer 14, scans the periphery of the turntable 32 
as it rotates, for data providing the computer with the exact 
rotational position of the turntable at any time, as 
5 described in more detail below. 

The motor 40 provides two rates of advance of the 
arm 38 and hence the microscope housing 30 radially across 
the annular zone of the turntable in which the objects 4 are 
mounted. These modes , here in turn "coarse* 1 and "fine" are 

10 both related to rotation of the disk such that each rotation 
causes the arm 38 to move incrementally along a radius of the 
turntable. The coarse increments are a multiple of the fine 
increments, so that, for example, if the fine increments are 
1 micron, the coarse increments may be 20 microns. It 

15 follows that, in this example, a succession of fine 
increments will mean that a traversal of the objects to be 
scanned will require twenty times as long as would be the 
case with a coarse scan. The coarse and fine scan are 
employed respectively during a normalization phase and an 

20 imaging phase of the operation of the device, as described 
further below. The mode of operation of the motor 40 and arm 
38, and the technology used, is essentially similar to that 
employed for moving the recording and/or playback heads of a 
magnetic or optical disk drive, although the requirements for 
25 precise absolute positioning of the head by the stepping 
mechanism may be less critical. 

In a preferred arrangement, positional data for 
pickup by the head 42 from the disk may be in the form of two 
regularly spaced tracks, one containing marks corresponding 
30 to the ones, and the other consisting of marks corresponding 
to the zeros, of a maximum length pseudo-random binary 
sequence, enabling the precise position of the disk at any 
time during its rotation to be determined by the control 
computer 14 through a calculation employing the generating 
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function of the particular maximum length sequence inscribed 
on the disk, as described for example in "Binary Sequences" 
by G. Hoffman de Visme, English Universities Press, or "Shift 
Register Sequences" by J. Golomb, Van Nostrand. 

5 As the turntable 32 rotates, the reflectivity of 

successive large radius arcs of the objects are detected, 
successive slides or other objects providing signal samples 
or pixels at the output of the ADC 28 proportional to the 
relative intensity of the reflected light at a particular 
10 point. The signal from the detector is sampled at a rate 
proportional to the speed of rotation of the disk and 
sufficient to provide the resolution required for the 
recognition of detail necessary for the process being 
performed, having regard for the processing speed of the 
15 computer 14 which receives the sampled pulses from tbe 
analog-to-digital converter 28. The information derived from 
the data picked up by the head 42 is employed by a switching 
unit 44 (see Pig. 5) associated with the computer 14 to 
switch data relating to each separate slide and assign it to 
20 its own coprocessing system 46 associated with the computer 
14. Each of the objects on the turntable has a separate 
coprocessing system assigned to it. Each coprocessing system 
will execute an identical program on the particular pixels 
switched to it from the analog-to-digital converter 28, 
25 although it will operate independently, and different 
subroutines and procedures may be executed by the different 
coprocessor systems in accordance with the data encountered 
in the course of their operation. Whilst the coprocessing 
systems may be implemented by a multi-tasking system, or 
30 separate processors, it is preferred that the processing 
systems are parallel autonomous sections of a single 
coprocessor unit appropriately segmented for the task. Each 
of the autonomous sections in the preferred embodiment forms 
part of a matrix of elementary computers operating in 
35 systolic mode, such that all computers in a particular row of 



the matrix perform the same operation on different data so 
that a sequence of different operations (as in an assembly 
line) is performed on a given data item as it travels down a 
column. This mode of operation, termed "SIMD- or "Single 
5 Instruction (per row) Multiple Data (per row) " is known in 
the art* A suitable systolic coprocessor unit is described 
in our co-pending United States Patent Application No. 
944,924. 

The time interval between receipt by a given 
10 coprocessor system of an arc or pixels from a slide or other 
object, and the time when it receives a following arc of 
pixels from the same slide, is termed its duty cycle, which 
is equal to the rotational speed of the disk, which in an 
exemplary embodiment might be 180 rpm, corresponding to the 
15 duty cycle of 330 milliseconds. During this period, the data 
received by each coprocessor may be processed to compress it 
utilizing known data compression techniques such as run 
length and/or Huffman encoding, subjected to enhancing 
techniques if required, and assembled with data from other 
20 arcs from the same slide to build up a compressed image. The 
processing may be such as to facilitate the recognition of 
anomalies, abnormalities or other distinctive features of the 
object being examined. Although the time required to examine 
and analyze data from an individual slide or other object may 
25 be lengthy, possibly as long as an hour, the large number of 
slides being processed simultaneously means that the actual 
average rate of examination can be quite high. Thus if sixty 
slides are processed in an hour, the average rate of 
processing is one a minute. It will also be noted that the 
30 arrangement just described entails only quite modest 
computational requirements for each of the coprocessor 
systems, even though the total quantity of data being 
processed may be very large. 



-fl- 
it is a feature of conf ocal microscopy that not only 
is it capable of excellent resolution in an image plane, but 
it also provides excellent rejection of data from points 
displaced on the Z axis relative to that plane. This has two 
5 consequences. Firstly, focusing is very critical, and 
secondly it is possible to image different planes of the same 
object to provide three dimensional imaging. The control of 
focus is an important aspect of the present invention. 



Each slide, or other object to be examined and 
10 located on the turntable, may have variations in thicxness 
and profile due to manufacturing tolerances, as well as much 
larger variations found in biological slide preparations due 
to the manner in which samples are placed on a slide. 
Furthermore, there may be manufacturing inaccuracies in the 
15 turntable, and in means provided to locate slides or other 
objects on the turntable. Since the turntable may be of 
significant diameter in order to accommodate a large number 
of objects, and rotated at a substantial velocity, mounting 
means provided for the objects must be sufficiently robust to 
20 locate them securely under these conditions. Furthermore, as 
is illustrated in Figure 6, cells C within a biological slide 
may be at different levels within a sample, and cells on one 
level may overlay cells located on another level. Conf ocal 
microscopy enables precision focusing on any layer, with 
25 resolutions in the micron range, in process microscopy, and 
particularly in the system already described, cells to be 
examined will be located at different heights above the upper 
surface of the slide on each slide, while cells at different 
points along the length and width of the slide may also 
30 differ in their height above the top surface of the slides. 
The slides may also be displaced relative to the optical axis 
both because of manufacturing tolerances in the slides and in 
the turntable upon which the slides are mounted. 
Consequently, there will be continuous variations in the 
35 axial position of wanted data as the turntable rotates, 
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requiring means for maintaining and controlling an 
appropriate focus of the lens 6. 

The coarse scanning mode is employed in an initial 
normalization phase in order to provide focus data which is 
5 stored in the computer 14 and utilized to control the 
focusing means 22 as the disk rotates. Such continuous 
control of focus is somewhat analogous to that employed in 
reading optical disks, although, as will be noted, the 
derivation of the data utilized to control focusing is 
10 substantially different* 

A focus may be initially established by a manual or 
automatic procedure utilizing the top surface 5 (see Figure 
6) of a slide or other object as a reference. To facilitate 
the procedures to be described , this top surface may be 
15 coated with a layer which has a high and known reflectivity 
at the wavelength of the light source 2. This known high 
reflectivity will result in an identifiable high level of the 
signal from the detector 12 when the lens 6 is focused on the 
slide surface. 

20 As the microscope housing 30 is subjected to coarse 

stepping across the lane of slides during a normalisation 
phase, an oscillatory waveform is applied to the focusing 
device such that it moves up and down through a distance of , 
for example, ±5 microns with respect to a reference level 

25 located, for example, one or two microns above the nominal 
surface level of each slide. The top surfaces of the slides 
will be areas of maximum reflectance, corresponding to a 
signal magnitude the value of which has already been stored 
in the control computer. The incoming signals are thus 

30 analyzed for the occurrence of this reflectance value, which 
can be noted whenever it occurs as a point at which the focus 
of the lens coincides with the surface of the slide. Using 
successive scans, the data gathered is vised to vary the 
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position of the reference level progressively for the portion 
of the scan over each side as necessary to find the top 
surface of the slide. By collecting this data, a nap can 
thus be established of the various slide surfaces. The 
5 oscillation technique is sometimes known as "dithering" in 
the technical literature, and the procedure employed to 
obtain depth information is somewhat similar but not 
identical to the process or interactive reconstruction 
employing geometric probing, a topic discussed in literature 

10 relating to robotics, for example by S. Skiena in "Problems 
in Geometric Probing", Algorithmica, Vol. 4, pages 599-605, 
1989. other data can also be gathered during this period for 
later reference, such as the upper surface B a sample 
applied to the slide, and the distribution therein of 

15 features such as cells having identifiable reflectivity 
characteristics. All of this data can be utilized to control 
the following imaging phase. 

Once the positions of the slide surfaces, or some 
alternative reference surface appropriate to the objects 

20 being examined, have been established, the imaging phase 
utilizing the fine stepping is commenced. The focus of the 
lens 6 is controlled according to the stored data so as to 
maintain the focus of the lens 6 at the reference level. If 
a three dimensional image is required, multiple scans may be 

25 utilized at displacements from the reference level which may 
be selected on the basis of other data collected during the 
normalization phase so as to image features of interest. 

In carrying out the coarse scan, the permissible 
coarseness will depend upon the application. For example, in 
30 biological slides, variations in thickness are typically 
negligible over lateral distances between 30 and 60 microns, 
whilst in most instances of practical interest in pathology 
and histology, cells found in such slides have a flattened 
thickness of between 3 and 8 microns. The relevant data 



• 11 - 

relating to each slide as determined during the coarse scan 
is stored in the processor system associated with that slide, 
and is utilized to control the focusing, i-e. the position on 
the Z axis of the lens 6, as it passes over that slide during 
5 successive scans. 

The data stored by each processor system in relation 
to its associated slide may thereafter be utilized to 
construct two or three dimensional images on an imaging 
system 48 for subsequent human assessment, or may be 
10 processed utilizing pattern recognition or other algorithms 
to recognize normal or abnormal features of each object , for 
example abnormal cells in a biological sample. 

Whilst the embodiment described utilizes a single 
microscope in the microscope housing 30 , it may be 

15 advantageous to provide 2, 3 or more similar microscopes 
distributed around the periphery of the turntable, in order 
to improve the scanning rate of the apparatus* Incorporation 
of such multiple microscopes in the system should not 
influence the resolution and performance obtained, and whilst 

20 they will influence the duty cycle by reducing the time 
available for each processor system to process the data 
associated with a scan of its associated slide, the time 
available should remain ample with any reasonable number of 
microscopes- Accordingly, the speed of the apparatus may be 

25 increased within reason simply by multiplying the number of 
microscopes utilized. 



CLAIMS: 

1- A confocal microscope system comprising a turntable 

having locations for mounting multiple objects to be examined 
in a ring thereon, means for rotating the turntable about an 
5 axis concentric with the ring, a microscope optical system 
mounted for radial movement relative to the turntable such 
that a focus of an objective thereof may be scanned over 
objects mounted in said locations, the microscope optical 
system including a point image detector providing a signal 
10 output, and signal processing means receiving said at least 
one signal output and separately processing those portions 
of said signal output associated with each object. 

2 . A system according to claim 1 , wherein the means for 

radially moving the microscope is correlated to rotation of 
15 the turntable to move the microscope incrementally for each 
rotation of the turntable, 

3 - A system according to claim 1 or 2, including a 
coprocessor system for signals associated with each object • 

4 - A system according to claim 3, where the coprocessor 
20 systems are portions of a matrix of systolic processors* 

5. a system according to claim 4, wherein the focusing 

means is a voice coil or a piezoelectric element. 

6 - A system according to any of the preceding claims , 

wherein the microscope is a confocal microscope, including an 
25 objective lens, and includes a focusing device for moving the 
focus of such lens in an axial direction relative to the 
turntable* 



30 



7 - A system according to any of the preceding claims, 

wherein the turntable carries a ring of encoded markings, 
including a pickup device for sensing said marking and 



- 13 - 



connected to the signal processing device so that the latter 
may identify portions of the signal output associated with 
different objects. 

8. a system according to claim 7, including a control 

5 computer for controlling said means for radially moving the 
microscope and operating said focusing means in two phases, 
a normalization phase in which the focusing means are 
controlled during scanning to vary the focus of the objective 
lens, and the data accumulated is analyzed to determine the 

10 axial position of a recognizable reference plane associated 
with each object so as to gather data mapping said plane for 
each object, and an imaging phase in which said focusing 
means is controlled to maintain the focus of said objective 
lens in a predetermined relationship to the plane mapped 

15 during the normalization phase. 

9 - A system according to claim 8, including means to 

repeat scans during the imaging phase a plurality of times 
whilst progressively altering the relation of the focus of 
the lens to the reference plane, to provide three dimensional 
20 data. 

10, A system according to any of the preceding cla ims , 
including a plurality of microscopes distributed around the 
periphery of the turntable. 

11. A confocal microscope system comprising a turntable 
25 having object locations for mounting in a ring multiple 

objects to be examined, means for rotating the turntable 
about an axis concentric with the ring, and at least one 
confocal microscope optical system having components mounted 
for movement in respectively radial and axial direction 
30 relative to the turntable such that an object region may be 
scanned through samples mounted in said sample locations, 
each confocal microscope system including a point image 
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detector providing a signal output , a demultiplexer receiving 
said signal output and isolating signals associated vith 
different sample locations , and signal processing means 
providing multiple channels for processing said signals 
5 associated vith different sample locations,, means for 
radially mounting said radially movable components to scan 
said sample locations / and means for controlling said axially 
movable components to focus said microscope firstly to 
establish focus reference data for each object and secondly 
10 to control the focus of said microscope responsive to said 
focus reference data. 

12. A method of process microscopy, comprising mounting 

a plurality of objects to be examined or analyzed on a 
turntable , rotating the turntable relative to a confocal 
15 microscope whilst moving the latter radially relative to the 
turntable , whereby to provide scanning of said objects in two 
dimensions, segmenting data output from said microscope and 
segregating data associated with each object, and separately 
processing said segregated data for each object. 

20 13. a method according to claim 12 , including 

controlling the focus of said microscope during rotation of 
said turntable. 

14. A method according to claim 13, wherein said focus 

is controlled during two successive scanning phases, 

25 including a first phase in which the microscope is moved 
radially in relatively coarse increments, and the focus of 
the microscope is varied systematically during scanning, data 
from the microscope relating to each object is analyzed to 
establish the focus locations where the signal indicates 

30 coincidence of focus with a layer providing a recognizable 
signal or response, and a second phase in which the focus of 
the objective lens is controlled so as to maintain a 
predetermined relationship to the position of the layer as 
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mapped during the first phase. 

15. A method according to claim 14, wherein the second 
phase is repeated for different relationships between the 
focus of the objective lens and the position of said layer, 

5 whereby to develop three dimensional image data. 

16. A method according to any of claims 12 to 15, 
including continuously monitoring the angular position of the 
turntable to identify an object currently being scanned, and 
directing data from different objects parallel data 

10 processing means associated with each object. 

17. a process microscopy system substantially as 
hereinbefore described with reference to the accompanying 
drawings. 

IB. A process microscopy method substantially as 

15 hereinbefore described with reference to the accompanying 
drawings . 
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